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Abstract. In many mean-field glassy systems, the low-temperature Gibbs measure 
is dominated by exponentially many metastable states. We analyze the evolution of 
the metastable states as temperature changes adiabatically in the solvable case of the 
spherical s + p-spin glass model, extending the work of Barrat, Franz and Parisi [J. 
Phys. A 30, 5593 (1997)]. We confirm the presence of level crossings, bifurcations, 
and temperature chaos. For the states that are at equilibrium close to the so-called 
dynamical temperature T^, we find, however, that the following state method (and the 
dynamical solution of the model as well) is intrinsically limited by the vanishing of 
solutions with non-zero overlap at low temperature. 
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1. Introduction 

Predicting the dynamical behavior of a system from a calculation of static quantities 
is the basic goal of statistical mechanics, where we consider the static average over all 
configurations rather than the joint dynamics of all the atoms. A particularly important 
case, both in classical and quantum thermodynamics, is given by the dynamics after 
very slow variations of an external parameter so that the system remains in equilibrium. 
Such changes are said to be "adiabatic" . 

In mean-field systems it takes an exponentially large time, in the size of the system, 
to escape from a metastable state. It is, thus, a well posed question to study the 
"adiabatic" evolution of each such metastable state. One simply needs to consider that 
the speed of change of the external parameter is very slow but independent of the system 
size. 

In glassy mean-field systems, at low temperatures, there are exponentially many 
metastable states. The equilibrium solution in these systems can be described using 
the replica theory or the cavity method pp. Adiabatic evolution of the states can be 
described using the Franz-Parisi potential [21 Ej. One fixes a reference equilibrium 
configuration at temperature T e and computes the free energy at temperature T a 
restricted to configurations sharing a given degree of similarity with the reference 
configuration. A distance can be defined in terms of the overlap of system configurations 
with the reference configuration and the constrained free energy is the Franz-Parisi 
potential. The adiabatic evolution of the metastable state, to which the reference 
configuration belongs, can, then, be represented by the set of local minima of the Franz- 
Parisi potential at the shortest distance from this configuration. 

Krzakala and Zdeborova recently introduced a procedure for following states that 
focuses directly on the minimum of the Franz-Parisi potential and is more easily tractable 
from a computational point of view [H [5] . The method has been applied to a number 
of glassy mean field systems including the fully connected Ising p-spin glass model, 
the diluted Ising p-spin model (XOR-SAT) or the random graph coloring. In all these 
systems, for T e below the dynamic arrest temperature Td and for T a low enough, the 
replica symmetric (RS) Franz-Parisi potential ceases to have a local minima correlated 
to the reference configuration. If the Franz-Parisi potential is, rather, evaluated using 
1RSB, the correlation with the reference configuration vanishes at a temperature T a 
lower than the one for the RS case, though it still vanishes. It was hence hypothesized 
that introducing further steps of replica symmetry breaking a physical solution might 
eventually be found. 

The current work is motivated by these findings and consists in the study of the 
adiabatic evolution of states in the spherical s + p-spin glass model with different 
competing p-body interaction terms, where an arbitrary level of replica symmetry 
breaking is relatively easily tractable (HI El [9] , and where, moreover, the dynamical 
behavior can be exactly solved PHI [EU H21 EES], and agrees with the results of the 
computation of the Franz-Parisi potential. 
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When following the evolution of the states in the spherical spin glass model as 
temperature is lowered we find once again the loss of correlation with the reference 
configuration. In this case, though, we are able to explicitly check that further levels 
of replica symmetry breaking do not preserve the correlation from vanishing. We 
will discuss the implications of such property throughout the paper and their possible 
connections to systems with discrete variables. 

The rest of the paper is organized as follows. Section [2] describes the model we 
study in this paper and summarizes the static replica equations under different levels of 
replica symmetry breaking. Section [3] derives the equations for evolution of states with 
the aid of the results we obtain in fully connected Ising p-spin model. In Section [4], we 
report results of the state evolution, discuss their physical meaning and compare them 



with existing results. Finally, in Section 4.4 we discuss the vanishing of states under 
cooling at low temperature. 

2. Model and its thermodynamics 

In this paper we study the spherical 3+4 spin-glass model with ferromagnetic interaction 
(3+4-FM model) whose Hamiltonian is 

h<h<h h<i2<h<h 

where the interactions J^\ 2 ip are i.i.d random Gaussian variables of mean S p p\/N p ~ l 
and variance j£p\ / (2N P ~ 1 ) , and the spins <7j real variables satisfying the global spherical 
constraint 

N 

J2^ = N - ( 2 ) 

i=l 

This model is a particular case of the general spherical spin glass model with 
ferromagnetic interaction defined by the Hamiltonian 

M 

H = ~ Yl Yl J S 2 ...* P (7 n^2 •••<%, (3) 

p=2 ii<i2<...<i p 

where several p-uples i% . . . i p ) of spins interacting via random Gaussian interactions 
j/fL , , with the mean and variance given above, are considered. It turns out that close 
to the transitions only the first two non-zero terms in the sum ^ are relevant [TU [J5] , 
and so one usually considers the Hamiltonian ^ where only two terms are retained. To 
indicate which terms are considered these models are referred as s + p-FM models. 

The equilibrium properties of these models can be obtained using the, now standard, 
replica method to average over the disorder. We briefly remind here the replica solution 
of this model as introduced in [HI d El El [16]. Introducing replicas and averaging the 
partition function over the disorder yields the static free energy functional, which reads 

- 2BF(B) = 1 + In 2tt + lim -G\q, ml , (4) 
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1,71 



G[q,m] = ^2g{q a b) + lndet (q - m <8> m) + ^ h(m a ) . (5) 



ab a=l 



where 



^=1^' (6) 

fc( m ) = ~™ P , = ZpPSp , (7) 

p ^ 

q = {q a b} is the (symmetric) overlap matrix, m = {m a } the magnetization vector in the 
replica space and <g> represents the outer product of vectors. The free energy G[q,m] 
must be evaluated at the solution of the saddle point equations 
dG[m, q] 



dq a b 
dG[m, q] 



a^b, (8) 

dm a °' ^ 
When breaking the permutation symmetry among replicas an Ansatz is imposed on the 
structure of overlap matrix q. For a generic i?-steps of replica symmetry breaking 
[T7] the matrix q is divided along the diagonal into successive boxes of decreasing 
size. In each box is constant and takes the value, from larger to smaller boxes, 
< qo < qi < . . . < qn < qn+i = 1. The saddle point equation are better written with 
the help of the two additional functions: 

A(g) = </(<?), u{m) = h ^. (10) 
where the "prime" denotes the derivative. 

2.1. RS and 1RSB solutions 

We first consider the case of no replica symmetry breaking R = 0, the replica symmetric 
(RS) Ansatz. The free energy Q then becomes: 

2 

- 2/3F(/3) = 1 + In 2tt + g(l) - g(q ) + log(l - 9o ) + + h(m)(U) 

i - qo 

while for the internal energy we have 

e(P) = -T[g(l)-g(q )}-^h(m). (12) 
The parameters go an d m are obtained from the self-consistent equations: 

A{%) = (T^F' ^^T^- (13) 

The particular RS solution m = q = gives the paramagnetic solution. 
The RS solution is stable if and only if 

A'(g )(l-go) 2 <l. (14) 
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This inequality is always satisfied for large enough temperature T. However as T is 
lowered the RS solution may become unstable and replica symmetry must be broken. 
The type of replica symmetry breaking, that is the value of R, depends on the terms 
appearing in the sum ([3]). If we limit ourself to the case 3+4-FM than only one step of 
replica symmetry breaking is needed [131 US] , see also the Appendix, thus R = 1 leading 
to the one-step RSB (1RSB) Ansatz. The free energy for 1RSB Ansatz reads: 



- 2/3FO0) 



0(1) - g(<ii) + x [#(<?i) - g{%)} + - in x{%) 

x 

x-1 , , , ?o-™ 2 



x 



x(go) 



(15) 



where 



x(Qi) 
x(?o) 



gi 
gi 



(16) 

x{q x - g ) • (17) 

The parameter x, called replica symmetry breaking parameter, represents the fraction 
of states (replicas) with overlap q±. Similarly for the 1RSB energy we have 

T, 



e(J3) 



-T 



0(1) - g(qi) + x [g(qi) - g(q )} 



-h(m). 



The order parameters qi, go, m, x are the solutions of the saddle point equations: 

A(9b) = , (19) 



X 2 (?i) 
A(g ) = 



gi - go 

x(giMgo) 



m 



x(gi) 



(20) 
(21) 



and the additional requirement of stationarity of G[go, gi, x, m] with respect to variation 
of x 



9(Qi) ~ 0(go 



In 



x z 



X(gi 
X(go). 



+ (gi - go) 



go — m 



1 



x(gi 



oj 



^x(go). ' 



The 1RSB solution is stable as long as 



and 



A(gi)x 2 (gi) < 1 



A'(g )x 2 (go) < 1 



(22) 



(23) 



(24) 



are satisfied. 

In systems with discontinuous 1RSB, besides the thermodynamic phase transition 
the replica theory also predicts a dynamic 1RSB (dlRSB) transition. The dlRSB 
solution can be obtained in the framework of the replica calculation using ( 19 )-(21 ) and 
a different equation in place of (22). The latter is the so-called marginality condition 
for dynamic arrest and requires that gi be marginally stable, that is 
.... 1 
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that ensures that the characteristic time of the correlation function diverges at, and 
below, the transition. This condition can be derived in different ways: (i) requiring that 
the complexity functional counting excited metastable states is maximal [6l HEJ EE] , or, 
equivalently, (ii) imposing that the lowest stability eigenvalue of the replica solution 
tends to zero [5J HH] • Else, (iii) it can be obtained as a saddle point equation for the RS 
solution with q = q\ sending the number of replicas n — y 1 rather than n — > [21 [31 [20] 
or, eventually, (iv) directly solving the equilibrium dynamics PHI E] ■ 

From the Legendre transform of (15) with respect to (3x, the complexity functional 
can be computed as 

2 df3F 



2£(<?i 



x 



— x- 



dx 

Qi ~ % 



-x 2 [g(qi) ~ g(q )} + x 2 A(q )(q 1 - q ) 
x(Qi) 



x{Qo) 



-In 



x(Qo 



Using (20) and the definition of x(Qo) (17), x can be eliminated and £(gi) 
rewritten as 



2S 



1 



2 C 



10 



In [(1 



C 



10 



A(gi 



A(?o) 



10 



qi) 2 C 10 ] 

[g(ii) - g(go) - A(g )(gi - Qo)] 



(26) 

can be 

(27) 
(28) 



q\ - qo 

where go is eliminated in favor of q± using 

A(q ) = (qo-m 2 )(l- qi ) 2 C 10 



(29) 



2.2. The 3 +4- FM model: phase diagram and complexity 

In this section we shortly summarize some features of the spherical 3+4-FM spin glass 
model that will be employed to test the states following procedure in the rest of the 
paper. In the following we choose, without loss of generality, S3 = S4 and J3 = J4. The 
phase diagram is displayed in Fig. [T] and consists of three equilibrium phases separated 
by red lines. At high temperature T and not too large S4 the phase is paramagnetic (PM) 
with q = m = 0, while at low T and sufficiently small S4 we have a spin glass (SG) phase 
of 1RSB type with q = m = 0. For large S4 the phase becomes ferromagnetic (FM) of 
RS type with both m and q positive. The transition to the FM phase is of first order, and 
the blue lines depict the spinodal lines of the FM and FM 1RSB -ferromagnetic of 1RSB 
type- metastable phases. Note that the FMirsb metastable phase goes continuously 
over a FM metastable phase, magenta line, before reaching the ferromagnetic transition. 
The SG transition is a discontinuous random first order transition, occurring at the 
Kauzmann temperature Tk, also called static temperature T s , horizontal red line. We 
shall use both notations depending on the context. Finally the horizontal green line gives 
the dynamical transition that occurs at the higher dynamical transition temperature Td, 
also called the mode coupling critical temperature. 
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Figure 1: Phase diagram of the 3+4-FM spherical spin glass model with J3 = J4 and S3 = S4. 
The lines are: Red full: static PM/SG transition; green full: dynamic PM/SG transition; red 
dashed: PM/FM transition; red dotted: SG/FM transition; blue dashed: FM spinodal; blue 
dotted: FMirsb spinodal; magenta dotted: FMirsb/FM transition. The latter is hardly seen 
on the left panel. Right: Detail of the spinodal lines. 



When the ferromagnetic FMirsb phase exists, its complexity, i.e., the logarithm 
of the number of metastable states, is extensive. We can then compare it with the 
complexity of the SG phase. The simplicity of the spherical model allows to plot them 
as function of q\ only. This is done in Figure [2] where the behavior of £(<?i) versus q\ 
is shown for three temperatures: T < Tk, T = Tk and T = T^. Not all values of q\ 
correspond to physical solutions, i.e., satisfy Eq. (23): only the thick lines refer to the 
interval in which £(51) counts physical solutions. The thin lines counts solutions that 
are unstable in the replica space, and hence unphysical. One can notice that the order 
of magnitude of the complexity of the FM 1RS b is two orders of magnitude smaller than 
that of the spin-glass phase. 



3. Equations for evolution of states for T e > T K 

In this section, we give the equations for adiabatic evolution of equilibrium states 
at T K < T e < T d in temperature T a following the planting procedure as introduced 
in Ref. [21J. We recall that the temperature Tk (or T s ) is the so-called Kauzmann 
temperature at which a true static thermodynamic glass transition takes place, at least in 
mean-field systems, between a paramagnet and a thermodynamically stable equilibrium 
glass (the ideal glass). For simplicity, we only consider models with S p = 0. 

For (3 e > Pk (that is, T e < T K ), in order to select an equilibrium configuration, 
we, first, generate a configuration randomly and then construct all of the interaction 
constants J^,^ so that the energy of the planted configuration equals e(/3 e ), cf. 
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Figure 2: Left: Complexity curves versus qi for the spherical 3+4-FM spin glass model 
with J 3 = J 4 and S 3 = S A = 0.62099. Left: £(<?i) for T = 0.7, T = T k = 0.76213 and 
T = Td = 0.80517 in the SG phase and in the FMirsb phase. Plot is in y-log scale to allow 
for comparison of complexity curves in both phases. Thick lines, hardly seen for the FMirsb 
phase, represent stable branches, thin lines unstable. Right: at T = 0.7 for the SG 

states (top) and for the FMirsb states (bottom). Vertical lines denote the instability point. 



Eq. (12). The important point is that, since above the Kauzmann temperature the 
RS quenched free energy is exactly the annealed free energy, the random planting 
ensemble is equivalent with the usual random ensemble, i.e. we can do a quiet planting 
[2T| [22J. This is a very non trivial property: as long as T > T#- when we generate a 
random configuration and a random set of interactions, so that this configuration is an 
equilibrium one, we have simply generated an equilibrated configuration of a typical 
realization of the usual random ensemble. 

It seems difficult to plant an equilibrium configuration in the spherical spin models 
due to the fact that {o~i}f =1 are real variables which can range from — oo to oo. However, 
the RS free energy of the spherical model with S p = equals that of Ising model [5], 
which means that the Gibbs measure of spherical model is dominated by the Ising 
configurations {—1, 1}^. Consequently, for the spherical model, we can follow the same 
planting procedure as introduced in the Ising model in order to derive the equations of 
the evolution of states. We refer the reader to [22] for details, but the point is that for 
such models where RS quenched free energy is the annealed free energy, one can map the 
following state procedure to a usual static computation in a model with a ferromagnetic 
bias. We shall briefly recall how this can be done: 

First, we generate a random configuration a with o~i G { — 1, 1}. We then generate 
the (planted ensemble) interactions according to 

P{J\a) oce-^n^f^O.^) . (30) 

ij ^ ' 

where J\f(x, x, A) is the normal distribution of mean x and variance A. In doing so, 
we have generated a typical configuration of the planted ensemble, which is the same 
as the quenched one as long as T > T K . In the annealed spherical model with S„ = 0, 
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the interaction variance scales as (J^ ip ) = J^p\/(2N P ~ 1 ), implying an extensive, 
O(N), energy and, thus, from the central limit theorem, we have the typical value 

Call a p-interaction is satisfied (unsatisfied) if the energy contribution 
■^1,12, a ii a i2 ' ' ' a ip is negative (positive). Then, at inverse temperature /3 e , we have 
the following expression for the fraction of unsatisfied interactions: 



where e(/3 e ) is defined in (12). As we only consider 8 e < f3 K} in the model with S p = 0, 
it leads to go = m = and therefore, 



6 2 2 V2JVP- 1 ' 1 j 

We now use the fact that this configuration can be transformed to a uniform one (all 
o~i = 1) due to the Gauge invariance, i.e., for any spin i, the transformation Oi —> —o~i, 
J a — » — J a (for all interactions a involving spin i) will keep the Hamiltonian pi) invariant. 



Then, for all p, choose the signs of interactions in the p-inter act ions: J^\ 2 j , such that 
fraction of them is unsatisfied. 

After this transformation is performed, we are left with the problem of finding where 
the uniform "all up" configuration is an equilibrium one, and where the distribution of 
interactions is given by 

p.v) K W^S,J£tV (33) 



with 



B F 

Sf = (34) 

In fact, (34) is exactly the Nishimori line condition for spherical p-spin spin glass model 
[5]. Therefore, for model with S p = and for T e > Tk, all of the thermodynamic 
properties of the states can be obtained from the phase diagram of the corresponding 
ferromagnetically biased model. In particular, since the planted configuration is an 
equilibrium one at T e , we can rewrite the complexity function (i.e., the logarithm of the 
number of equilibrium thermodynamic states) at T e as following: 

£(&) = -PeF({S p = 0}) + (3 e F({Sf}) (35) 

from which we can determine the dynamical temperature T^, i.e., the highest 
temperature at which Eq. (35) becomes positive, and the Kauzmann temperature Tk, 
at which Eq. (35) goes to zero. The reader interested in this correspondance between 
the following state procedure and the Nishimori line is referred to [2U El E2] for more 
details. 
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4. Results and discussion 

In this section we present the results of adiabatic state following for the spherical 3+4- 
FM spin glass model with J 3 = J4 = 1, and S3 = S4 = 0, we discuss their physical 
meaning and compare with the existing results. 

4-1. Mapping to the phase diagram of the ferromagnetically biased model 

By exploiting the equivalence between the evolution of states that were the equilibrium 
ones above Tk and the thermodynamic properties of the model on the Nishimori line, 
we can acquire all the information about how states evolve with temperature from 



the phase diagram of the spherical 3+4-FM spin glass model discussed in Sec. 2.2 and 
plotted in Figure [TJ Due to the Nishimori condition we will now have S| ff = Sf 1 = (3 e /2. 
We show the phase diagram in the T e , T a space in Figure [3j where the Nishimori line, 
given by T e = T a , is plotted as a black line: it intersects the spinodal transition line 
at the dynamical temperature Td and it exactly crosses the intersection of three phase 
transitions lines at the Kauzmann temperature, T a = T e = T%. In the inset of Figure [3] 
we emphasize the re-entrant nature of the FM phase, comparing the borderline of the 
FM phase (red dotted) and the FM spinodal line (blue dotted) with vertical arrows, 
respectively at T e = Tk and T e = Td. The magenta line separates the FM and FMirsb 
(metastable) phases. 

To interpret this phase diagram for the adiabatic evolution of Gibbs state we 
consider states that were at equilibrium at temperature T e , Tk < T e < Td. The 
Nishimori line T a = T e is hence the equilibrium line for T e > Tk- As T a increases 
the states encounter the ferromagnetic spinodal (blue dash-dotted line) and "melt" into 
the paramagnet. As T a decreases there are three possible cases depending on the value 
of T e between Tk and Td, c.f.r. Figure [3} Starting from T e = Tk, and increasing T e , we 
have: 

• For T e > Tk, the state can be followed lowering T a using the RS Ansatz down to 
zero temperature. 

• As T e becomes larger than the value where the FM/FMirsb transition line touches 
the T a = axis, see Fig. |3j then the state can be followed using the RS Ansatz 
only down to a bifurcation temperature T a = Tirsb, where the crossing with the 
FM/FMxrsb transition line occurs. Here the state splits into exponentially many 
sub-states with a 1RSB structure. This ensemble of states can be followed down to 
zero temperature using the 1RSB scheme. 

• Finally when T e becomes larger than the value where the FM spinodal line touches 
the T a = axis, the state can be followed as before with RS Ansatz down to T^rsb, 
where the crossing with the FM/FMirsb transition occurs, and below this point 
with the 1RSB Ansatz. However at difference with the previous case we cannot 
reach T a = 0, but we have to stop at the temperature T a = T sp fm where we cross 
the reentrant FM spinodal line. Below this temperature ferromagnetic solutions 
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Figure 3: Phase diagram of the spherical 3+4-FM spin glass model as a function of 
temperature T a , and T e (2T e = 1/S^). Three thermodynamic phases are present separated 
by red lines: PM, SG an FM. The blue line is the spinodal line, while the green line is the 
dynamic PM/SG transition. For more details on the lines see Fig. [TJ Note that both the 
FM phase transition and the spinodal line are reentrant, as emphasized in the insets. The 
metastable state that appears at the spinodal line is either FM or FMirsb- The magenta line 
denotes the transition between these two phases. 



of any type do not exist anymore. Within the state following interpretation of 
the phase diagram this means that the state completely disappears, and hence no 
solution exists correlated with the state in equilibrium at T e . The vanishing of 
states will be further discussed in section 14.41 



4-2. Evolution of states 

Figure [4] shows how the energy of states evolves in temperature, compared with the 
equilibrium energy, thick yellow line in figure, from the 1RSB computation [19]. The 
top part of the figure shows the result of state evolution computed within the RS Ansatz 
from Eqs. (13), with S p given by denned in Eq. (34). Upon warming, the energy 
of the state grows up to a spinodal temperature beyond which the only solution is 
(qo,m) = (0,0). As T e approaches Td from below, the energy of the spinodal point 
decreases gradually and goes to e{Td) at T e — > Td. Note that this is not the case for the 
pure spherical p-spin spin glass model, where one retains only on term in the sum ([3]), 
which is kind of pathological in this aspect. The states at equilibrium at Td do not exist 
at any temperature higher than T^. Upon cooling, the energy decreases. However, for 
T e close enough to Td the only RS solution of Eqs. (13) at low T a is the paramagnetic 
one. 
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Figure 4: Evolution of states in spherical 3+4-FM spin glass model for Tjc < T e < T^. 
Top: The RS result; the thick yellow curve is the equilibrium energy e(T) in the model 
with S3 = S4 = 0. Other curves are the evolution of energy of states with T e = 0.805166(= 
Td), 0.8, 0.785, 0.773, 0.76213(= Tk), respectively. Notice that the equilibrium state at T e = Td 
disappears as soon at T a < T e . Inset: Difference between the equilibrium energy of model and 
the energy of states of equilibrium at T e = Tk ~ 0.76213. Bottom: The result for T e = 0.805 
(left) and T e = 0.8 (right). The RS part is drawn in solid line and the 1RSB result in dashed 
line. For T e = 0.805 (left) the state following ends at T sp fm = 0.4794 where the reentrance of 
the FM spinodal line is reached. 



The energy of states at equilibrium at T e = Tk, followed at T a < Tk, is different 
from the equilibrium energy and their difference is shown in the inset of Figure [4] (a). 
This indicates that these states fall out of equilibrium upon cooling, in contrast with the 
pure spherical p-spin spin glass models where the equilibrium state at T e = Tk is always 
at equilibrium for T a < Tk- Thus, level crossing and temperature chaos do appear for 
T e < Tk in the spherical 3+4-FM spin glass model. 

The lower part of Figure [4] shows the evolution of states computed with the 1RSB 
Ansatz, which is stable in this case [19J. The 1RSB solution, with (m,go) 7^ (0,0) 
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and qi ^ qo, corrects the RS result below the state splitting temperature Tirsb- As 
illustrated on the left, for T e close enough to we encounter the reentrant spinodal 
line, below which no solution of the 1RSB equations is found with m > 0, and the state 
following ends. 




Figure 5: Comparison of the results derived from following states method (red line) and 
that from iso-complexity approach [23] (blue line with stars) where T e = 0.8. Inset: The 



difference between the two energies , e exa ct — ei SO , as a function of T a 



Finally, let us compare our results for adiabatic state following with an "iso- 
complexity" approximation proposed in Ref. [23] to study the cooling procedure in 
one state. In the iso-complexity approximation we count the logarithm of the number 
of the states at T a vs. energy and we choose the energy such that this number equals 
the equilibrium complexity at T e . The true state following energy cannot be lower than 
the iso-complexity energy prediction, because, otherwise, there would not be enough 
states at T a at such lower energy, but it can be higher, since states that were not the 
equilibrium ones dbt> T e can contribute to the complexity. We show in Figure ^the energy 
of the state at equilibrium at T e = 0.8 at different T a computed using our exact method 
and the iso-complexity approximation. As we expect, the iso-complexity provides a 
lower bound to the true energy of the state (see the difference in the inset). This result 
is different from the case of the pure spherical p-spin spin glass model, in which the two 
methods give the same results because states do not cross or disappear. 

4-3. Relationship with Franz-Parisi potential 

The results presented in the previous sections are equivalent to the results of Ref. |24j . 
The Franz-Parisi potential measures the free energy at temperature T a of the system 
at fixed overlap with a solution sampled from equilibrium at temperature T e . Under 
our planting mechanism, magnetization is exactly the overlap between the configuration 
in the state of equilibrium at T e and the typical configuration in the same state at T a ; 
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Figure 6: Free energy of a state at T a at a fixed overlap with a configuration at 
equilibrium at T e . Here, T e = 0.805 and T a = 0.9 (a), 0.805 (b), T 1RSB = 0.7525 
(c), 0.6 (d), T sp FM = 0.4794 (e), 0.45 (f), respectively. The solid red line represents 
the RS free energy and the dashed line the 1RSB free energy. The marks indicate the 
minimum of the free energy. 



therefore, the free energy of the model with a ferromagnetic bias at a fixed magnetization 
can be directly translated into the Franz-Parisi potential. 

Figure [6] shows the Franz-Parisi potential for the spherical 3+4-FM spin glass 
model with S| ff = (3 e /2, i.e., the free energy of the configurations linked to that at 
the equilibrium temperature T e , versus the magnetization m for T e = 0.805, close to 
Td, and different T a . The position on the cooling path is shown in the left panel of 
Figure [7], where the displayed temperatures T a are indicated by points. The right panel 
of Figure [7] shows the value of the parameters q, qo, q%, m, x along the cooling path from 
T a = T e = 0.805 down to T a = T spFM = 0.4794. For T a > T s , Figure g (a), the 
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Figure 7: Left: Zoom into the T a , T e phase diagram. The cooling path at T e = 0.805 is 
denoted by the full-line. The temperatures T a shown in Fig. [6] are indicated by squares. 
Right: The magnetization m (black solid line) and the parameters q (RS) and qo, qi and x 
(1RSB) as function of T a along the cooling path T e = 0.805. The magnetization m coincides 
with the local minimum m* of the free energy shown in Fig. [6j In the FM phase the overlap 
q (green solid line) increases when cooling down and splits into qo and q\ (red lines) when the 
(continuous) transition to the the FMirsb phase is reached. The breaking parameter x (blue 
line) is, discontinuous, and jumps from zero to a finite value. The metastable FMirsb solution 
eventually disappears at T sp fm = 0.4794 and below this point no ferromagnetic solution exists. 



Franz-Parisi potential does not have any secondary minimum at m > besides the one 
at m = 0. When T 1RSB < T a < T s , see Figure [6] (b), a secondary local minimum at 
m* > develops in the RS potential. At Tirsb = 0.7525, see Figure[6] (c), this minimum 
becomes unstable towards 1RBS, the dashed part of the curves. When cooling further, 
the minimum in RS free energy disappears, while it still exists for the 1RSB free energy, 
see Figure [6] (d). The latter disappears when the reentrance of the FM spinodal is 
reached for T a = T spFM = 0.4794, see Figure [6] (e), and beyond this point the Franz- 
Parisi potential ceases to have a minimum for m > 0, see Figure [6] (f). These results are 
equivalent to those of Ref. [21] , though there the case represented in Figure [6] (f) was 
not considered. 



4-4- A loose end in the following states 

Starting from the equations for the Langevin dynamics, authors of Ref. [23] and Ref. [25] 
derive explicitly the adiabatic evolution of order parameters for the spherical 3+4-FM 
spin glass model, see Equation (25)-(26g| in |24j or Equation (12) in Ref. |25j (notice 
that there J 4 = 0.45J 3 as chosen rather than J 4 = J 3 ). These equations are exact 
description of the dynamics for T a > Tirsb (denoted T ag in Ref. [25]). 

For T a < T 1RSB the dynamical solution of [231 122] is approximate because aging 
appears within states for such temperatures. The dynamical equations they obtain are 



the same as our 1RSB equations (19)-(21), and also coincide with stationarity of Franz- 



| There was a mistake in Equation (26) of Ref. [21] that has been corrected in Ref. [2"5] . 
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Figure 8: Energy (top) and magnetization m (bottom) as function of T a along the path 
T e = 0.653 for the spherical 3+4-FM spin glass model with J3 = 1, J4 = 0.45 (to compare 
with results of Ref. [25J). At T a = Tirsb the RS solution becomes unstable and the FMirsb 
appears. Red: results from the following states method, Green: results from the approximate 
dynamic solution of Ref. [2H The following of states ends at the = 0.355 and 

-^spFM = 0-288, respectively, where the corresponding spinodal lines are reached. The energies 
of the two different method are almost indistinguishable, however but < E^ d \ 



Parisi potential function with respect to qi,qo and m. The stationary condition (22) 
is, however, replaced by the marginal condition (25), as expected from a dynamical 
calculation. 

We then conclude that also the dynamical solution provided in Ref. |25j disappears 
because of the reentrance in the phase diagram of the spinodal line in the spherical 3+4- 
FM spin glass model, although at temperature slightly lower than the reentrant 
spinodal T S p FM found from the static calculation. We plot the corresponding energy in 
the top panel of Figure [8j The bottom panel Figure [8] shows the value of m for the two 
solutions. The vanishing states at low temperature was not noticed in Refs. [2U [2S] , 
because the data were for higher temperatures. 

The disappearing of the states at the spinodal line rises the question of what may 
happen below this point. In the model we have studied the state, indeed, disappears. 
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Therefore, the true long-time dynamics would completely de-correlates from the initial 
configuration (m = 0). We are unable, so far, to predict at which energy the long- 
time dynamics will go from this point: this is a fundamental limit of the following state 
approach. It would be interesting to see if another approach allows to infer the long-time 
dynamics. 

An interesting question is whether this behavior will be seen in other models with 
discrete, rather than continuous, variables. In fact, states vanishing seems to appear 
in many models, including the Ising counter-part of the p-spin model. However at 
low temperature the phase space of fully connected Ising models is more complex and 
is described by a FRSB Ansatz. This opens the question of the interplay between the 
state following method and the complexity of phase space. Hopefully, this can be studied 
along the line of the spherical case here presented. 

Another direction to study the fate of the states at temperature T sp fm is to perform 
long and slow Monte-Carlo simulations starting from an equilibrated configuration (this 
can be achieve using the planting trick [21, 22J). We view these questions as an important 
open problem in the replica theory and pointing this clearly out is one of the main aims 
of this article. 

5. Conclusion 

In this paper, we study the adiabatic evolution of states that are at equilibrium at some 
temperature T e {T K < T e < T d ) in the spherical 3+4-FM spin glass model. We stress 
that while the study was performed for the 3+4-FM spin glass model, the results are 
generic for all s+p-FM spin glass model with only 1RSB low temperature phase. 

After introducing the idea of planting an equilibrium configuration, the following 
states problem is mapped to the physics of the ferromagnetic solution in the 
corresponding model with a ferromagnetic bias, i.e., the model along the Nishimori line. 
We exactly describe the evolution of states away from equilibrium upon heating and 
cooling. This method is equivalent to the one based on the Franz-Parisi potential |24j. 
Within our mapping the Franz-Parisi potential is the free energy at fixed magnetization. 
Our method also reproduces the known results about the long time dynamics which is 
solvable for the spherical p-spin spin glass model [25J . 

The most interesting outcome of this paper is identification of a sort of boundary 
in the state following method and, hence, also in the Franz-Parisi potential and the 
dynamical solution for the spherical 3+4-FM spin glass model. We show that it is 
related to a reentrant behavior of spinodal lines in the phase diagram. For the states 
that are at equilibrium close to the dynamic transition temperature, we found that 
below a low but finite temperature, where we cross the reentrant spinodal line, no 
solution with a finite magnetization occurs, i.e., the correlation with the initial state 
at equilibrium is completely, and discontinuously, lost. In the spherical 3+4-FM spin 
glass model no physical solution with more than one step RSB takes place, thus no 
further fragmentation of states can be accounted to remove the reentrance: the states 
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simply stop to exist. This leaves the following questions for future work: (1) Below 
the reentrance the following state method, or equivalently the Franz-Parisi potential, 
is unable to tell where and at which energy the dynamics will end. Is there a way to 
perform a static computation answering this question? (2) In the first part (RS) of the 
following state, the phase space is relatively simple and decreasing T a just constraints 
the system closer to the reference state and m increases (in the ferromagnetic notation). 
This lasts until we reach the FM/1RSB transition where the phase space breaks down 
and becomes more complex. From this point on it becomes harder to stay close the 
reference state because the different states in which the phase space is broken into evolves 
chaotically (chaos in temperature). What happens beyond the FM/1RSB transition is 
thus an important point to study further. (3) Is the behavior similar in the Ising models? 
While the RS and the 1RSB solution both display a reentrance, other solutions breaking 
the replica symmetry can exist and be self-consistent for discrete spin systems at low 
temperature, so it is possible to conceive that the reentrance shrinks and disappears 
allowing to follow states down to zero temperature. This is again an important point 
to study further. 

The answer to all those question is calling for more detailed simulation of the Ising 
case, and more analytical studies. We hope that this article will motive future attention 
and work in these directions. 



Appendix 

In this section, we recall the general condition that ensures whether solutions with R- 
RSB (R > 0) can exist. This proof has already been presented, see [6j [13], and it is 
reported here for completeness For any R (including oo) the functional G[q, m] ^ can 
be written as 

1 f 1 f qR dq q -m 2 



n 



G[q, m) = / dqx(q) A ? + / + In (1 - q R ) + + h{m) , 

(36) 



where the function 

R 

x(q) =Po + ^(Pr+i - PrW(q - q r ) (37) 

r=0 

is the cumulative probability density of the overlaps, p r (p = n and Pr + i = 1) are the 
sizes of the blocks along the diagonal and q r the value of q a b in the block, and 

X(0) = / d q x(q'). (38) 

For what concerns Replica Symmetry Breaking, only the overlap variables are involved 
and not single replica index parameters, such as magnetization m a . Stationarity of 
the free energy functional with respect to q r and p r leads, respectively, to the the self- 
consistency equations than can be concisely written as 

T{q r ) = Q, r = 0,...,i?, (39) 
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where 



dq F{q) = 0, 



F{z) = A(z) - r 
Jo 



R, 



dq 

x(q) 



2 ' 



(40) 



(41) 



Eq. (40) implies that -F(q) has at least one root in each interval [q r -i, g r ], that, however, 



is not a solution of (39). Following Ref. 



we, then, observe that (39)-(40) guarantee 



that between any pair [g r _i,g r ] there must be at least two extremes of J-"(q). Denoting 
the extremes by q*, the condition J-'(q*) = leads to the equation, cf. Eq. (41), 

•i i 



where 



A'(g) 



x(q) 



dA(q) 
dq 



^{p-l) m i 



(42) 



(43) 



Since x(q) is a non-decreasing function of q, cf. (37), x(q) 1S convex. The convexity of 
the function [A'(g)] -1 / 2 depends, instead, on the given values of multi-body interaction 
g(p) considered, i.e., on the specific model, as well as on the parameters fj, p , i.e. on the 
phase diagram point of interest. Non-zero values of the magnetization will affect the 
actual value of go, it will be go > for but it will not change the above argument 

since it only affects the values of q at which x(g) displays steps, but not the convexity 
properties of the function. 

The [A'(g)] -1 / 2 for the 3+4 model that we deal with throughout this paper, is 
plotted in Figure [9] in different points of the phase diagram. The shape of [A'(g)]" 1 / 2 , 
concave, implies that at most a 1RSB solution can take place, excluding, among others, 
also any solution with a continuous RSB. This argument can be extended to show that 
1RSB will be the most complicated solution for all s + p systems in which [A'(g)] -1 / 2 
never becomes convex for q 6 [0 : 1]. Given a value of s (equivalently of p) value this is 
quantitatively translated in satisfying the condition p < p*(s) (s < s*(p)), where p* (or 
s*) is solution of 



(p 2 +p + s 2 + s - 3sp) 2 -ps(p-2)(s - 2) = 
at fixed s (or p), e.g., (s*,p*) = (3,8), (4,7 + 2^6), (5,9 + 3^5). 



(44) 
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